Dynamics of Social Harms in an Algorithmic Context

Growing evidence suggests that the affordances of algorithms can reproduce socially embedded bias and discrimination, increase the information asymmetry and power imbalances in socio‑economic relations. We conceptualise these affordances in the context of socially mediated mass harms. We argue that algorithmic technologies may not alter what harms arise but, instead, affect harms qualitatively—that is, how and to what extent they emerge and on whom they fall. Using the example of three well-documented cases of algorithmic failures, we integrate the concerns identified in critical algorithm studies with the literature on social harm and zemiology. Reorienting the focus from socio‑economic to socio-econo-technological structures, we illustrate how algorithmic technologies transform the dynamics of social harm production on macro and meso levels by: (1) systematising bias and inequality; (2) accelerating harm propagation on an unprecedented scale; and (3) blurring the perception of harms.

Dynamics of Social Harms in an Algorithmic Context

Growing evidence suggests that the affordances of algorithms can reproduce socially embedded bias and discrimination, increase the information asymmetry and power imbalances in socio‑economic relations. We conceptualise these affordances in the context of socially mediated mass harms. We argue that algorithmic technologies may not alter what harms arise but, instead, affect harms qualitatively—that is, how and to what extent they emerge and on whom they fall. Using the example of three well-documented cases of algorithmic failures, we integrate the concerns identified in critical algorithm studies with the literature on social harm and zemiology. Reorienting the focus from socio‑economic to socio-econo-technological structures, we illustrate how algorithmic technologies transform the dynamics of social harm production on macro and meso levels by: (1) systematising bias and inequality; (2) accelerating harm propagation on an unprecedented scale; and (3) blurring the perception of harms.</div

Collectivized Discretion: Seeking Explanations for Decreased Asylum Recognition Rates in Finland After Europe's 2015 “Refugee Crisis”

In 2015, during the so-called “refugee crisis” in Europe, Finland was among the European countries receiving exceptionally large numbers of asylum applications. As the volume of asylum applications surged, however, the percentage of positive asylum decisions in Finland declined substantially. In this article, we explore reasons for this dramatic drop in recognitions rates and examine Finnish immigration control authorities’ use of discretion in asylum credibility assessment. Our approach is unique in its application of mixed methods to examine asylum decisions in pre- and post-crisis situations. We found that asylum caseworkers’ inconsistent assessment of similar facts and lack of faith in the veracity of applicants’ claims were essential to the mass denial of young Iraqi asylum applicants in Finland. This finding is important because it illustrates how asylum officers are able to “shift the border,” or generate a shift in asylum decision-making on a grand scale, without meaningful changes in law. Asylum officers, we show, are able to bring about such a shift via what we call collectivized discretion, or large-scale use of discretion, in asylum status determinations to control migration. Prior research on discretion in asylum decision-making highlights the individual decision-maker. This article expands discretion research by offering new insights on large-scale, collective discretionary shifts in the application of asylum law. We conclude that it is crucial that asylum status determinations be anchored in the individual assessment of each applicant's case, as collectivized discretion can lead to arbitrary results in the application of asylum law, potentially forcing those in need of refugee protection to face deportation.</p

Explaining automated decision-making: a multinational study of the GDPR right to meaningful information

The General Data Protection Regulation (GDPR) establishes a right for individuals to get access to information about automated decision-making based on their personal data. However, the application of this right comes with caveats. This paper investigates how European insurance companies have navigated these obstacles. By recruiting volunteering insurance customers, requests for information about how insurance premiums are set were sent to 26 insurance companies in Denmark, Finland, The Netherlands, Poland and Sweden. Findings illustrate the practice of responding to GDPR information requests and the paper identifies possible explanations for shortcomings and omissions in the responses. The paper also adds to existing research by showing how the wordings in the different language versions of the GDPR could lead to different interpretations. Finally, the paper discusses what can reasonably be expected from explanations in consumer oriented information.</p

Explaining automated decision-making: a multinational study of the GDPR right to meaningful information

The General Data Protection Regulation (GDPR) establishes a right for individuals to get access to information about automated decision-making based on their personal data. However, the application of this right comes with caveats. This paper investigates how European insurance companies have navigated these obstacles. By recruiting volunteering insurance customers, requests for information about how insurance premiums are set were sent to 26 insurance companies in Denmark, Finland, The Netherlands, Poland and Sweden. Findings illustrate the practice of responding to GDPR information requests and the paper identifies possible explanations for shortcomings and omissions in the responses. The paper also adds to existing research by showing how the wordings in the different language versions of the GDPR could lead to different interpretations. Finally, the paper discusses what can reasonably be expected from explanations in consumer oriented information.TALFÖ